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Mission: Advance state-of-the-art in prognostics technology development 


• Investigate algorithms for estimation of remaining life 

- Investigate physics-of-failure 

- Model damage initiation and propagation 

- Investigate uncertainty management 

• Validate research findings in hardware testbeds 

- Hardware-in-the-loop experiments 




Requirements 


Automatic 

Contingency 

Management 


Integration 


Uncertainty 

Management 


Prognostics 

Algorithms 


- Accelerated aging testbeds 

- HIL demonstration platforms 

Disseminate research findings 

- Public data repository for run-to-failure data 

- Actively publish research results 

Engage research community 


Validation 

and 

Verification 


How should prognostic requirements be expressed and 
how should prognostic performance be measured 


How should prognostic information be incorporated in decision 
making to ensure safety and satisfy mission objectives? 


How can the proper operation of prognostic algorithms be 
verified and validated, especially on new systems? 


How should prognostic information from different, 
interacting subsystems be combined and processed? 


How can the information from multiple uncertainty 
sources be properly represented and processed? 


What is the best prediction algorithm for a 
particular application? 


• Prognostics Center of Excellence, NASA Ames Research Center, CA [http://www.prognostics.nasa.gov] 
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Introduction to Prognostics 

Outline 
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Today we will discuss... 
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• What is prognostics? 

- It’s relation to health management 

- Significance to the decision making process 

• How is prognostics used? 

- Reliability 

- Scheduled maintenance - based on reliability 

- Kinds of prognostics - interpretation & applications 

• Type I, Type II, and Type III prognostics 

• Various application domains 

• Condition based view of Prognostics 

• Prognostic Framework 
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Also... 
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• What are the key ingredients for prognostics 

- Requirements specifications - Purpose 

• Cost-benefit-risk 

- Condition Monitoring Data - sensor measurements 

• Collect relevant data 

- Prognostic algorithm 

• Tons of them - examples 

- Fault growth model (physics based or model based) 

- Run-to-failure data 

• Challenges in Validation & Verification 

- Performance evaluation 

- Uncertainty 

• representation, quantification, propagation, and management 
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Prognostics and Health Management 

The Perspective 
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Health Management 
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Control 
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Maintenance 

Preventive 

Maintenance 


Maintenance 
Data Analysis & 
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Condition Monitoring 
Reliability Analysis 


Schematic adapted from: A. Saxena, Knowledge-Based Architecture for Integrated Condition Based Maintenance of Engineering Systems, PhD Thesis, Electrical and Computer Engineering, Georgia Institute of 
Technology, Atlanta May 2007. 

Liang Tang, Gregory J. Kacprzynski, Kai Goebel, Johan Reimann, Marcos E. Orchard, Abhinav Saxena, and Bhaskar Saha, Prognostics in the Control Loop, Proceedings of the 2007 AAAI Fall Symposium on 
Artificial Intelligence for Prognostics, November 9-11, 2007, Arlington, VA. 
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System Model for 
Diagnosis 


Simulated 

Data 


Data Driven 
Methods 
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• Adapted from presentations and publications from Intelligent Control Systems Lab, Georgia Institute of Technology, Atlanta [http://icsl.gatech.edu/] 
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Prognostics 

• Dictionary definition - “foretelling” or “prophecy” 

• PHM definition - 

“Estimation of remaining life of a component or subsystem” 

• Prognostics evaluates the current health of a component and, 
conditional on future load and environmental exposure , estimates at 
what time the component (or subsystem) will no longer operate within 

its stated specifications. 

• These predictions are based on 

- Analysis of failure modes (FMECA, FMEA, etc.) 

- Detection of early signs of wear, aging, and fault conditions and an assessment of 
current damage state 

- Correlation of aging symptoms with a description of how the damage is expected 
to increase (“damage propagation model”) 

- Effects of operating conditions and loads on the system 
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Prognostics Center of Excellence, NASA Ames Research Center, CA [http://www.prognostics.nasa.gov] 

Prognostics [http://en.wikipedia.org/wiki/Prognostics] 
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Goals for Pro gnostics 

What does prognostics aim to achieve? 
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• Prognostics goals should be defined from users’ perspectives 

• Different solutions and approaches apply for different users 
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User Centric View on Prognostics Goals 


Qf 
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Category 

End User 

Goals 

Metrics 


Program 

Manager 

Assess the economic viability of 
prognosis technology for specific 
applications before it can be approved 
and funded 

Cost-benefit type metrics that translate prognostics 
performance in terms of tangible and intangible 
cost savings 

Operations 

Plant 

Manager 

Resource allocation and mission 
planning based on available 
prognostic information 

Accuracy and precision based metrics that 
compute RUL estimates for specific UUTs. Such 
predictions are based on degradation or damage 
accumulation models 

Operator 

Take appropriate action and carry out 
re-planning in the event of 
contingency during mission 

Accuracy and precision based metrics that 
compute RUL estimates for specific UUTs. These 
predictions are based on fault growth models for 
critical failures 


Maintainer 

Plan maintenance in advance to 
reduce UUT downtime and maximize 
availability 

Accuracy and precision based metrics that 
compute RUL estimates based on damage 
accumulation models 

Engineering 

Designer 

Implement the prognostic system 
within the constraints of user 
specifications. Improve performance 
by modifying design 

Reliability based metrics to evaluate a design and 
identify performance bottlenecks. Computational 
performance metrics to meet resource constraints 

Researcher 

Develop and implement robust 
performance assessment algorithms 
with desired confidence levels 

Accuracy and precision based metrics that employ 
uncertainty management and output probabilistic 
predictions in presence of uncertain conditions 

Regulatory 

• Saxena, A., Celaya, J., 1 

Policy Makers 

>aha, B., Saha, S., Goebel, K., “Metric 

To assess potential hazards (safety, 
economic, and social) and establish 
policies to minimize their effects 

i 

Cost-benefit-risk measures, accuracy and precision 
based measures to establish guidelines & timelines 
for phasing out of aging fleet and/or resource 

allocation for future projects 


Conferences and Computers and Information in Engineering Conference (IDETC/CIE), San Diego, CA 
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Prognostics Categories 

• Type I: Reliability Data-based 

- Use population based statistical model 

- These methods consider historical time to failure data which are used to model 
the failure distribution. They estimate the life of a typical component under 
nominal usage conditions 

- Example: Weibull Analysis 

• Type II: Stress-based 

- Use population based fault growth model - learnt from accumulated knowledge 

- These methods also consider the environmental stresses (temperature, load, 
vibration, etc.) on the component. They estimate the life of an average 
component under specific usage conditions 

- Example: Proportional Hazards Model 

• Type III: Condition-based 

- Individual component based data-driven model 

- These methods also consider the measured or inferred component degradation. 
They estimate the life of a specific component under specific usage and 
degradation conditions 

- Example: Cumulative Damage Model, Filtering and State Estimation 

• For more details please refer to last year’s PHM09 tutorial on Prognostics by Dr. J. W. Hines: [http://www.phmsociety.org/events/conference/phm/09/tutorials] 
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Forecasting Applications 
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■ I 

A prediction threshold exists Non-monotonic models 

Use monotonic decay models No thresholds 




Predict values Predict trends 

Increase/decrease 


Electronics Medicine 

Aerospace Mechanical systems 


• Saxena, A., Celaya, J., Saha, B., Saha, S., Goebel, K., “Metrics for Offline Evaluation of Prognostics Performance”, International Journal of Prognostics and Health Management (IJPHM), vol.1 (1 ) 2010. 

• Saxena, A., Celaya, J., Balaban, E., Goebel, K., Saha, B., Saha, S., and Schwabacher, M., “Metrics for Evaluating Performance of Prognostics Techniques”, 1st International Conference on 
Prognostics and Health Management (PHM08), Denver CO, pp. 1-17, Oct 2008. 
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Predicting Remaining Useful Life 

Understanding the Prognostic Process 
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Fault Dimension (a) 


Prognostics Framework 


or 
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Fault Dimension (a) 


Prognostics Framework 
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We hardly have access to ground truth 

Instead we have measurements, appropriate features of which may correlate 

to damage, such data are usually noisy! 

We use these data to learn the model, which may be noisy 

Noise may have a significant effect on the learnt model... 



to t D t P EoL 


Decision Risk 


How soon is too soon and 
how late is too late? 


Model Uncertainty 

Which model to trust? No 
Model is perfect ! 


No Ground Truth 


Ground truth measurements 
are hard to come by 


Noisy Data 

Measurement noise leads 
to more uncertainty! 
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Uncertainties in Prognostics 
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• Uncertainties arise from a variety of sources 

- Modeling uncertainties - Epistemic 

• Numerical errors 

• Unmodeled phenomenon 

• System model & Fault propagation model 

- Input data uncertainties - Aleatoric 

• Initial state (damage) estimate 

• Variability in the material 

• Manufacturing variability 

- Measurement uncertainties - Prejudicial 

• Sensor noise 

• Sensor coverage 

• Loss of information during preprocessing 

• Approximations and simplifications 

- Operating environment uncertainties - Combination 

• Unforeseen future loads 

• Unforeseen future environments 

• Variability in the usage history data 





Unknown level of 
uncertainties arising due 
lack of knowledge or 
information 


Inherent statistical 
variability in the process 
that may be characterized 
by experiments 


Unknown level of 
uncertainties arising due 
to the way data are 
collected or processed 
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These uncertainties can be represented as a probability distribution on the initial state. 
Probability distribution need not be Normal “always”. 

we can propagate the learnt model along with a confidence bound until the Failure Threshold is reached 


The Horizontal slice tells us when the system can be expected to reach a specified failure threshold given “all” uncertainties 

considered 
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Prognostics Framework 
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Risk is now a compound function of chosen failure threshold and the decision point 
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Prognostics Framework 
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We can figure out if the system would withstand by the time mission is completed 
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Prognostics Framework 
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■30 

= f t 1 “ p n <4 - h ))ph (o)da 



= 1 - } P d (a|« = t 3 ) p H (a)rfa 


Probability of damage 
given a hazard zone 
Pdf -p^a) 


•-Time (t) 


t 3 EoL 


Damage size pdf at a 
given time can be useful 
when planning a mission 
(usage) profile 
Answers how risky it is to 
go on a mission of known 
duration? 


Probability distribution 
for damage size at any 
given point - p a {ri) 


We can figure out if the system would withstand by the time mission is completed 
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Examples 

Prognostics Applications 
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Application Examples 



Ames Research Center 






Electro-Mechanical Actuators 


Electrochemical Stora 


Electronics 
Valves, Pumps 
Composite Materials 
Solid R ^^^ Vlotor Casing 

Distributed Health M^l^mient 


SunSPOT 


PROGNOSTICS CENTER OF EXCELLENCE 


23 




Ames Research Center 


Setting up the Problem 

Prognostics Modeling 
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Data-Driven Prognostic Methods 

Primarily use data obtained from the system for predicting failures 

• What kind of data? 

- Something that indicates a fault and fault growth or is expected to influence fault 
growth 

• Sensor measurement to assess system state 

• Sensor measurements and communication logs to identify operational modes and operational 
environment 

- Process data to extract features that “clearly” indicate fault growth 

• Preferably monotonically changing since faults are expected to grow monotonically 

- Predictions can be made in many ways 

• Use raw measurement data to map onto RULs 

• Use processed data to trend in feature domain, health index domain, or fault dimension domain against 
a set threshold 

• How? 

- Learn a mathematical model to fit changing observations 

• Regression or trending 

• Learnt model may not be transparent to our understanding but explains observed data 

- Use statistics if volumes of run-to-failure data is available 

• Map remaining useful life to various faulty states of the system 

• Reliability type RUL estimates 
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Example - Data-Driven Prognostics Model 
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• Operational conditions 

- Indicate level of stress on the system 

• Ground truth measurements 

- Ground truth measurements are less frequent 




Operational conditions seem to make an impact on how fast the damage grows ! 
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Example - Data-Driven Prognostics Model 


Qf 
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Sensor Measurements 

- Features are extracted form sensor data 

- Depending on what is measured 
features will have noise w.r.t. damage 
growth 

- All run-to-failure units follow their own 
track 



Time 



Generally speaking features indicate the level of damage at any given time 
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Approach 
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• Learning/training 

- Learn a mapping (Ml) between 
features and the damage state 

- Learn a mapping (M2) between 
operational conditions and 
damage growth rate 

• Prediction 

- At any given time use Ml & 
latest measurements to estimate 
damage state 

- Assuming a future load profile (if 
unknown) estimate damage 
accumulation for all future 
instants using M2 



RUL Predictions using GPR 



• Goebel, K., Saha, B., and Saxena, A., “A Comparison of Three Data-Driven Techniques for Prognostics”, Proceedings of the 62nd Meeting of the Society For Machinery Failure Prevention Technology 
(MFPT), pp. 119-131, Virginia Beach VA, May 2008 
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Data-Driven Prognostic Methods 

• Advantages 

- Relatively Simple to implement and faster 

• Variety of generic data-mining and machine learning techniques are available 

- Helps gain understanding of physical behaviors from large amounts of data 

• These represent facts about what actually happened all of which may not be apparent from theory 

• Disadvantages 

- Physical cause-effect relationships are not utilized 

• E.g. different fault growth regimes, effects of overloads or changing environmental conditions 

- Difficult to balance between generalization and learning specific trends in data 

• Learning what happened to several units on average may not be good enough to predict for a specific 
unit under test 

- Requires large amounts of data 

• We never know if we have enough data or even how much is enough 

• Examples 

- Regression 

- Neural Networks (NN) 

• RNN, ARNN, RNF 

- Gaussian process regression (GPR) 

- Bayesian updates 

- Relevance vector machines (RVM) 
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Physics-Based Models for Prognostics 
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Use fault propagation models to estimate time of failure 

• What kind of models? 

- A model that explains the failure mode of interest 

- A model that maps the effects of stressors onto accumulation of damage - 
Physics of failure driven 

• e.g. fatigue cycling increases the crack length, or continuous usage reduces the battery capacity over a 
long term can be modeled in a variety of ways 

• Finite Element Models 

• Empirical models 

• High fidelity simulation models, etc. 

- Modeled cause-effect phenomenon may be directly observable as a fault or not 

• Structural cracks are observable faults 

• Internal resistance changes in a battery causing capacity decay are not directly observable 

• How? 

- Given the current state of the system simulate future states using the model 

• Recursive one step ahead prediction to obtain k-steps ahead prediction 

- Propagate fault until a predefined threshold is met to declare failure and compute 
RUL 
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Physics-Based Models for Prognostics 
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• Advantages 

- Prediction results are intuitive based on modeled case-effect relationships 

• Any deviations may indicate the need to add more fidelity for unmodeled effects or methods to handle 
noise 

- Once a model is established, only calibration may be needed for different cases 

- Clearly drives sensing requirements 

• Based on model inputs, its easy to determine what needs to be monitored 

• Disadvantages 

- Developing models is not trivial 

• Requires assumptions regarding complete knowledge of the physical processes 

• Parameter tuning may still require expert knowledge or learning from field data 

- High fidelity models may be computationally expensive to run, i.e. impractical for 
real-time applications 

• Examples 

- Population growth models like Arrhenius, Paris, Eyring, etc. 

- Coffin-Manson Mechanical crack growth model 


• Engineering Statistics Handbook [http://www.itl.nist.gov/div898/handbook/apr/section1/apr15.htm] 
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Hybrid Approaches 

Use knowledge about the physical process and information from 
observed data together 

• How? 

- Learn/fine-tune parameters in the model to fit data 

- Use model to make prediction and make adjustment based on observed 
data 

- Learn current damage state from data and propagate using model 

- Use knowledge about the physical behavior to guide learning process 
from the data 

• Improve initialization parameters for learning 

• Decide on the form for a regression model 

- Use understanding from data analysis to develop models 

• Discover the form of the fault growth model 

- Fuse estimates from two different approaches 

- or any other creative way you can think of. . . 
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Examplel - Physics Model Tuned with Data 
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Predicting Battery Discharge - Short Term 

• Objective: Predict when Li-ion battery voltage will dip below 2.7 volts 

• Hybrid approach using Particle Filter 

- Model non-linear electro-chemical phenomena that explain the discharge process 

- Learn model parameters from training data 

- Let the PF framework fine tune the model during the tracking phase 

- Use the tuned model to predict EOD 




• Data Source: NASA PCoE Data Repository [http://ti.arc.nasa.gov/tech/dash/pcoe/prognostic-data-repository/] 

• B. Saha, K. Goebel, Modeling Li-ion Battery Capacity Depletion in a Particle Filtering Framework, Proceedings of Annual Conference of the PHM Society 2009 
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Example2 - Develop Empirical Model from Dat 
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Example2 - Data-driven Regression 

• Use a regression algorithm to make predictions 

- Gaussian Process Regression 



Ames Research Center 
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Hybrid Approaches 
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• Advantages 

- Does not necessarily require high fidelity models or large 
volumes of data - works in a complementary fashion 

- Retains intuitiveness of a model but explains observed data 

- Helps in uncertainty management 

- Flexibility 

• Disadvantages 

- Needs both data and the models 

- An incorrect model or noisy data may bias each other’s 
approach 

Otherwise, it’s a compromise to get the best out of both so any 
disadvantage may be alleviated 

• Examples 

- Particle Filters, Kalman Filters, etc. 

- or any clever combination of different approaches. . . 
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Example 1 

Electrolytic Capacitors 
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ON-LINE OFF-LINE 


Research Approach 
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Capacitor Degradation Model 
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Pristine Capacitor 
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• An aluminum electrolytic capacitor, consists of 

- Cathode aluminum foil, 

- Electrolytic paper, electrolyte 

- Aluminum oxide layer on the anode foil surface, which acts as 
the dielectric. 

- Equivalent series resistance (ESR) and capacitance(C) are 
electrical parameters that define capacitor health 

cathode 
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Degradation Mechanisms 
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Aging in the 
dielectric material 
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Experimenta l Setu ps 

• Conditions under investigation 

- Nominal Degradation 

- Electrical Over Stress 

- Thermal Over Stress 

• Characterization of capacitors at regular 
intervals 

• Impedance measurement instrument used to 
characterize the capacitors. 

• ESR and Capacitance values are computed 
using a system identification tool. 
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Accelerated Aging Studies 
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• Under normal operating conditions 

- Device lasts for several years 

- Process of condition based monitoring becomes 
difficult 

• Advantage of accelerated stressors 

- We can run the component to failure 

- Allows for the understanding of the effects of failure 
mechanisms, 

- Identification of leading indicators of failure 

- The development of physics-based degradation 
models and RUL prediction 
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Accelerated Electrical Aging 



Capacitor popping 
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Capacitance Degradation Model 
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Decrease in electrolyte volume : 


where: 

V: dispersed volume at time t, V e : initial electrolyte volume 
A s : surface area of evaporation, j eo : evaporation rate 
t : time in minutes, w e = volume of ethyl glycol molecule 


Capacitance (C) ): Physics-Based Model: 

C = (2eR€oA s )/dc 

Electrolyte evaporation dominant degradation phenomenon 

- First principles: Capacitance degradation as a function of electrolyte loss 


where: 

C : capacitance of the capacitor, 
€r : relative dielectric constant, 
€o : permittivity of free space, 
dc : oxide thickness. 


Ve{t) = V e0 - ( w e A s j eo t ) 


(D 



(3) 
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Capacitance Degradation Model 
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• Oxide breakdown observed - experimental data 

• The breakdown factor is exp. function of electrolyte evaporation 

C b k(t) = ex P f ( V eo - V e(t)) 

• Updated in capacitance degradation model : 


C = (2eneoA s Cbk)/dc, 

V e0 ~ V e (t) 


T> n : C(t) = c bk(t) 


jeo t W t 


Phn 
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Dynamic Model of Capacitance 
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From the structure of capacitor we have the electrolyte volume (V e ) expressed 
in the form of oxide surface area (A s ) as : 



The first order discrete approximation for change in electrolyte volume can be 
expressed as: 


dVe 

dt 


(w e A s j eo) i 


^e(fc+ 1) — ^e(fc) + 



^ / e(fc+ 1) v e{k) (w e A s j eo )At. 



Phn ntesm^tfrfiY IHaferra* - N c E 
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Dynamic Model of Capacitance 


C k 9 

v e(k) = — & 

2eReQCb k 

Ve( k ) = (C k )0L 
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Similarly Capacitace can be expressed as : 


C k a + ~~ At, 


C k+1 a 

C k+ ia = C k a - ( w e A s j eo )At , hence 
C k + 1 


dt 


C k - K^Weo) At 


a 



The complete discrete time dynamic model for capacitance degradation can be 
summarized as : 



Phn 
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Dynamic Model of ESR 
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• Decrease in electrolyte volume : 

Ve(t) = Veo - ( w e A s j eo t ) 


• ESR 

- Based on mechanical structure and electrochemistry. 

- With changes in R E (electrolyte resistance ) 


where: 

Pe ■ electrolyte resistivity, 

Pe : correlation factor related to electrolyte spacer porosity and average liquid 
pathway, 

e bk(t) '• resistance dependence oxide breakdown factor 



Dynamic ESR degradation Model : 
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Electrical Overstress Experiment 
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• Electrolytic capacitors of 2200pF, 
10V, lAand at 85°C 

• Stress voltages 

- 1 20% , 1 50% of rated voltage 

• Under Electrical Overstress 

- Capacitance Health Threshold - 20% 

- ESR Health Threshold - 250 - 280% 

• Charging / discharging cycle - 1 5V 




Phn ni^^^tirth N n^f^rv^& _ ENcE 




Electrical Overstress Experiment 
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Increase in pressure 


Phn nte-smtstirih" - - - Opening of the pressure vefrifei 


EOS Experiments : 

• 3 Capacitors failed due to vent 
opening. 

• Pressure increase in other 
devices observed. 
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Electrical Overstress Degradation Da 





Devices were characterized at 
regular intervals. 

Impedance data shows 
degradation in C and ESR with 
aging 

C and ESR values were computed 
from the impedance data 





Thermal Overstress Experiment 
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Thermal Chamber 


Exposure of the capacitors to 
temperatures T applied (105 C) > T rated 
(85 C) results in accelerated aging 
of the devices 

High temperature on the surface 
causes heat to flow radially towards 
the core of the capacitor 

Temperature increase leads to 
electrolyte evaporation 

Health Threshold Storage condition 
- capacitance decreases > 10%) 

Oxide breakdown observed 



1O J OOOuF,1&/n08‘C 


- 3400 hrs 

- 3400 hrs 


Capacitance decrease ( > 15 - 17%) 


Linear decrease till 2800 hrs 

▼ 

T RT 


+25°C 
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Nominal Operation Experiment 
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• Three sets of DC-DC converters 
with electrolytic capacitors under 
test 

• Main components include 
MOSFET's, isolating 
transformers, PWM controller 
chip and an electrolytic 
capacitor 

• Characterization of capacitors 
done at regular time intervals. 



- Voltage source shut down, 
capacitors discharged 

- Experiment was started with Input DC voltage^ 

conditions intact again till the next < 22V > 
measurement 

For this experiment ESR increase ( > 103% ) and 
capacitance decrease ( > 8%) 


DC-DC Converter 

'-'test 

Rl 

Hardware 



1 ' L T 


Vo(5V pp ) 
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Summary of RUL forecasting results TOSS^ 

Ames Research Center 

Exp e rim ents 

• 2200|jF capacitors at 105°C 

• Capacitance Degradation Model 

V4 


Aging 

Time 

Evporation 
Rate (jeo) 

Evap. Rate and 
Oxide Breakdown 


RA a i 

RA a 2 

2421.92 

90.15 

94.47 

2500 

85.71 

97.86 

2650 

78.18 

94.76 

2800 

65.00 

95.15 

3000 

43.18 

95.00 

RAb 

92.32 

93.52 
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Example 2 

Li-Ion Batteries 
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Background 
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• For Li-ion, a common chemistry 

- positive electrode consisting of lithium cobalt oxide 
(Li x Co02) 

- negative electrode of lithiated carbon (Li x C). 

• Electrolyte enables lithium ions (Li + ) to diffuse 
between the positive and negative electrodes. 

• Intercalation/charging and 
deintercalation/discharging process 
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Background - Discharging 
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On connecting to load 

• current flow leads to 
oxidation reaction 


> C + it:Li + + X 


T . discharge 

Li^C — 

• liberation of Li ions and 
electrons 

• positive electrode the 
reduction reaction takes 
place 

t * v-v r * _i_ — dischai ge ^ ^ 

Li x _ x Co0 2 + xLi + xe — — — > LiCoO : 


| W# ^r ~ — | 

V 

TO 

m 

m 


no it 
bOoc 

ODO 3 

OQQC 


V 


Li s CoQ;> Separator Li x C 

Current Collector - Current Collector 
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Background - Charging 
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• During charging 


• active material in the 
positive electrode (anode) is 
oxidized and Li ions are de- 
intercalated 

LiCo0 2 U 1 _ x Co0 2 + X-Li + + xe 

• results in the loss of Li ions 
and electrons, which can 
then move to the negative 
electrode (cathode). 


i(t) Current Source 


ipmc 

TO 

Li - 

m 

Me 

^ Lij.Co0 2 
+ Current Collector 

Separator 

Li x C ^ 

- Current Collector 


_ charge 


Li.C 


C + xLi + 
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Aging Process 

^ ■ 

• Solid-electrolyte interface (SEI) layer 

- degradation in the negative electrode 

- increase in impedance 

• Lithium corrosion 

- degradation with aging 

- decrease in capacity. 

• Lithium plating 

- irreversible loss due to plating formation 

• Contact Loss 

- SEI layer disconnects from the negative electrode, 
impedance increase 
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Problem Formulation 
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Prognostics goal 

- Compute EOL = time point at which component no longer meets 
specified performance criteria 

- Compute RUL = time remaining until EOL 

^ , , , State Parameters Input Process Noise 

System model \ \ / 

x(i) = f(<,x(t),e(t).u(f).v(t)) 

Output y ( i ) = h(f,x(i),0(t),1l(t),n(t)) SensorNoise 

Define threshold that determineR if EOL has been reached 

rp , at ,,, / 1, if EOL is reached 

T BO L(x(f),0(f)) = | o, otherwise. 




E %f (f p) 14rgS?|o L fx S (f ), 0( t)) = 1 RUL(t P ) = EOUtp ) - t P 

t^t p 

Compute p(EOL(tp)\yo:t P ) and/or p(RUL(t P )\yo- tp ) 
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Prognostics Architecture 
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System receives 
inputs, produces 
outputs 


Prognostics 


u(k) 



r 





w 

Estimation 

p(x(k),9(k)\y(k 0 :k P )) 

Prediction 

1 p{k E {kp)\y{ko\k P )) 

w 


1 J 

1 

L 

A 





2 

I Estimate current 
state and parameter 
values 


3 

Predict EOL and 

I RUL as probability 
distributions 
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i(t) 


Battery Modeling 

• Overall Battery Voltage 

- potential at positive current collector 

- potential Negative current collector 

- resistance losses 

• Equilibrium potential 

- Nernst Equation 

• Surface over-potential v<) * 

- Butler-Volmer 

• Solid-phase resistance 

- treated as constant and lurrt^ed c togeth@r 


Load 
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■<f> a (0,t) 

■<t>s(L, t) 


+ Current Collector 


ator Li x C 

- Current Collector 
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Battery Volta ge 

• The total battery voltage can be given as : 
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V = V UtP - Vu „ - V n - V„ n -V. 


U,n 


o 


?hp 




Change in voltage levels and transients 


where 




V' 

V f 

rt,n 






f 



- (f>s{L, t) 
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Constant 2A discharge 
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• Model fits very well 

• The accuracy towards the end of discharge is most 
sensitive to the 

- Redlich-Kister parameters 

- Diffusion constant 


Volume of surface 
layer 


£ 3 . 2 - 


^ 3 . 6 - 
> 

<L> T 4 - 
a/) •*•*+ 


3 . 8 - 


4 - 


3 - 



Measured 

— - Predicted 


2 . 8 - 


2 . 6 - 


1000 2000 3000 4000 5000 6000 7000 8000 9000 10000 

Time (s) 
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Variable Loading 
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• Load changes every 2 
mins 

• Results in 
corresponding changes 
in voltage 

• Predictions are fairly 
accurate 

• Some errors still present 
possibly accounted by 
thermal effects 


5 - 


4 - 


C 7 - 


u 

2 - 


1 - 


0~l i , , i i i— 

800 1000 1200 1400 1600 1800 2000 2200 

Time (s) 



PROGNOSTICS CENTER 


OF EXCELLENCE 


68 


Battery Aging - Experiments 
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• EOD point moves earlier in 
time due to diminished 
capacity. 

• Voltage drops down during 
discharge due to increased 4 
resistance 

• Steady-state voltage after | J5 

cc 

discharge increases 1 

2.5 

2000 4000 6000 8000 

Current (A) 



- Cycle 16 

- Cycle 26 

- Cycle 36 

- Cycle 46 

- Cycle 56 

- Cycle 66 

- Cycle 76 

- Cycle 86 

- Cycle 96 

- Cycle 106 

- Cycle 116 

- Cycle 126 

- Cycle 136 

- Cycle 146 
Cycle 156 
Cycle 166 
Cycle 176 
Cycle 186 
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Battery Aging Model 


4 - L 
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• Total available charge in the 
battery is represented through 

qimax 



3000 4000 

Time (s) 


6000 


• Loss of active material 

• Decrease in voltage due to Butler 
Volmer term 

• Increase in internal resistance 
captured through an increase in 
the Ro parameter 


(a) Decreasing q max . 




0 1000 2000 3000 4000 5000 6000 

Time (s) 

(c) Decreasing q max and R 0 . 
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Battery Aging Model 

• Dynamics near EOD are 
dominated mainly by the 
equilibrium potential 
contribution with some 
contribution from the Butler- 
Volmer dynamics 

• combined effects, with qmax 
decreasing by 1 % and Ro 
increasing by 5% with each new 
discharge. 

• Similar to observed in 
experimental data 
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(b) Decreasing R 0 . 
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Prognostics Performance 


• UKF is used for state 

3.8- 

estimation £ «- 

<L> 

f 3.4- 

• Each sigma point is 
simulated forward using 

kJ 2.8 - 

the model until EOD is “j- 
reached 

• We assume future 

6000 -I 

loading points 

• Model tracks very well , 4000 
under different conditions 3000 

2000- 


0 4- 
0 
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Prognostics results for 2 A 
discharge 




s. 


A k* E 

[(1 — a)Ak* E , (1 + a)Afcg] 
• Median A k /. Prediction 
5-25% and 75-95% Ranges 








1000 2000 3000 4000 

Time (s) 


Prognostics Performance 
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Each sigma point is 
simulated forward using 
the model until EOD is 
reached 

We assume future 
loading points are knowr 

Model tracks very well 


*app 

PRMSE RA 

RMAD#£/ L 

1.0 

0.19 

92.77 

1.07 

h- 

m 

Qi 

0.17 

96.02 

0.88 

2.0 

0.17 

99.38 

0.75 

2.5 

0.26 

97.75 

0.82 

3.0 

0.41 

96.08 

0.92 


under different conditions 
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Prognostics Performance 
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EOD being defined in this*> 

case as 3:35 V. ^ 

> 

In the open loop, the f “ 

model slightly “; 

overestimates EOD 

80 

Model tracks very well 
under different conditions 


Voltage Estimation 

Measured 

— Estimated Mean 

Estimated Min/Max 



900 1000 1100 1200 1300 1400 1500 1600 

Time (s) 


EOD Prediction 


• RA averages 88:41% 

1500- 
^ 1000 - 


A k* E 

[(1 — a)Akg, (1 4- a)Afcjr] 
• Median A kg Prediction 
5-25% and 75-95% Ranges 
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0-1 1 1 — 

0 500 1000 

Time (s) 


— i 

1500 


Conclusions 
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• Discussed the lumped parameter electrical equivalent 
models 

- Study the links between the equivalent models and different 
degradation conditions. 

• Stressors leading to degradation in capacitors are 
electrical and thermal overstress conditions respectively 

• Developed appropriate experimental setups, 

- conducted laboratory experiments 

- Simulating capacitors under different operating conditions. 

• Development of generalized physics based degradation 
models for C and ESR 

- Structural and manufacturing data 

- First principles of operation 

- Experimental Data 
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Discussion 
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• Electrochemistry based model discussed 

• Prognostics results for EOD predictions are 
accurate 

• The model can be applied to battery packs 

• Two approaches 

• Either each battery modeled individually 

• Battery pack lumped to a single cell 
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Prognostic Performance Evaluation 

Prognostics Metrics 
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Role of Prognostics Metrics 


Cost of 
unscheduled 
repair 


r 

Time 

1 

R 

fo 

squire 
r repa 

d ’ 

dr 

V 

action 

J 


Fault 

Evolution 

Rate 


Cost of lost 
or incomplete 
mission 


A 


1 

C 

Failure 

'riticalit 

y 1 

L 


J 


Cost of 
incurred 
damage 



z 
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A 

ac 

al 

hievat 

gorith 
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■ 
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J 


< 


Requirement 
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Algorithm 

Selection 




XZ 


PROGNOSTICS 

METRICS 


Algorithm 

Fine-tuning 


Ames Research Center 



r 



L: 

Algorithr 

"omplexi 
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Performance 

Specifications 


Performance 

Evaluation 
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Prognostic Performance Metrics 

• New metrics were proposed specific to prognostics for PHM 

• These metrics were applied to 

• A combination of different algorithms and different datasets 

• Metrics were evaluated and refined 


or 
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• Prognostics horizon 

• a-A performance 

• Relative accuracy 

• Cumulative relative accuracy 

• Convergence 





Source: A. Saxena, J. Celaya, E. Balaban, K. Goebel, B. Saha, S. Saha, and M. Schwabacher (2008,). Metrics for evaluating performance of prognostic techniques. International Conference on 
Prognostics and Health Management, PHM 2008. 6-9 Oct. 2008 Page(s): 1-17. 
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Prognostic Performance Metrics 

• Metrics Hierarchy 
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I. Prognostic Horizon 

• Does the algorithm predict within desired accuracy around EoL and sufficiently in 
advance? 



II. a-A Performance 

• Further does the algorithm stay within desired performance levels relative to RUL at a 
given time? 


W 


III. Relative Accuracy 

• Quantify how well an algorithm does at a 
given time relative to RUL 


IV. Convergence Rate 

• If the performance converges (i.e. satisfies above 
metrics) quantify how fast does it converge 
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Prognostic Horizon (PH) 


• Prognostic Horizon is defined as the difference between the time index i when the 
predictions first meet the specified performance criteria (based on data accumulated 
until time index i) and the time index for End-of-Life (EoL). The performance 
specification may be specified in terms of allowable error bound (a) around true EoL. 


^EoL h ap 

i a p is the first time index when predictions satisfy ^-criterion 
for a given a 

min |fr| (kep)A\^x[r(k)] + _ a a j>fi'j 

p is the set of all time indexes when predictions are made 

l is the index for I th unit under test (UUT) 

/? is the minimum acceptable probability mass 

^[ r (£)]“- ' s the probability mass of the prediction between a-bounds 
given by a + = r* + a • t EoL and a~ =n - a- t EoL 

r(k ) is the predicted RUL distribution at time tj 
r EoL is the predicted End-of-Life 

The range of PH is between (t EoL -t P ) and max[ 0, t EoL -t EoP \ 
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a- A Accuracy 
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• a-A Accuracy determines whether at given point in time (specified by X) prediction 
accuracy is within desired accuracy levels (specified by a). Desired accuracy levels 
for ant time t are expressed a percentage of true RUL at time t. 
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RUL 


Comparing Various Algorithms 


or 
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Prediction Horizon (5% error) Prediction Horizon (1 0% error) 





RVM 

GPR 

ANN 

PR 

PH (weeks) 

8.46 

12.46 

12.46 

24.46 



RVM 

GPR 

ANN 

PR 

PH (weeks) 

12.46 

16.46 

12.46 

24.46 


PR > GPR = ANN > RVM PR > GPR > ANN = RVM 
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